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We study possible quantum ground states of the Heisenberg antiferromagnet on the star lat- 
tice, which may be realized in the recently discovered polymeric Iron Acetate, Fe3(^3-0)(^- 
OAc)6(H20)3 [Fe3(/i3-0)(/i-OAc)7.5]2- 7H20fl' Even though the Fe^'' moment in this material carries 
spin-5/2 and the system eventually orders magnetically at low temperatures, the magnetic ordering 
temperature is much lower than the estimated Curie- Weiss temperature, revealing the frustrated 
nature of the spin interactions. Anticipating that a lower spin analog of this material may be synthe- 
sized in future, we investigate the effect of quantum fluctuations on the star-lattice antiferromagnet 
using a large-iV Sp(A'^) mean field theory and a projective symmetry group analysis for possible 
bosonic quantum spin liquid phases. It is found that there exist only two distinct gapped Z2 spin 
liquid phases with bosonic spinous for non-vanishing nearest-neighbor valence-bond-amplitudes. In 
particular, the spin liquid phase which has a lower energy in the nearest-neighbor exchange model 
can be stabilized for relatively higher spin magnitudes. Hence it is perhaps a better candidate for 
the realization of quantum spin liquid state. We also determine the magnetic ordering patterns 
resulting from the condensation of the bosonic spinous in the two different spin liquid phases. We 
expect these magnetic ordering patterns would directly be relevant for the low temperature ordered 
phase of the Iron Acetate. The phase diagram containing all of these phases and various dimerized 
states are obtained for the nearest-neighbor exchange model and its implications are discussed. 



I. INTRODUCTION 

The search for quantum spin liquid phases in two and 
three dimensions has lead to recent discoveries of several 
spin-1/2 frustrated antiferromagnets, where no magnetic 
ordering has been seen down to the lowest temperature. 
The examples include a triangular lattice organic ma- 
terial close to a metal- insulator transition^, Kagome or 
Kagome-like lattice systems^-'i.'^, and a three-dimensional 
hyber-Kagome lattice material^. The nature of possi- 
ble spin liquid and other competing phases in these sys- 
tems has been a subject of intense research activities. 
While there has been considerable progress in under- 
standing some of the candidate quantum paramagnetic 
phases such as quantum spin liquid^-i^iSiiiSiiiii^ii^ and va- 
lence bond solid phasesi^ii^i^, a general understanding 
of the interplay between competing phases upon the vari- 
ation of the spin interactions is still lackingii. Therefore, 
systematic studies of a variety of frustrated magnets with 
possibly different spin interactions and/or with different 
underlying lattice structures would be extremely usefulJ^ 

In this regard, the recent discovery of the Iron Ac- 
etate may present one of such useful examples for a 
two-dimensional frustrated lattice^. Here Fe'^^ spin-5/2 
moments reside on the star lattice as shown in Fig.([T]). 
The Curie- Weiss temperature is estimated to be 6cw — 
— 581K, but the magnetic ordering occurs only below 
Ttv = 4.5K (the nature of the magnetic order is presently 
not known), leading to a large frustration parameter, 
/ = \Qcw\/Tn = 129 > 1. This raises the hope that 
spin liquid phases may exist for a lower spin analog of 
this material. 

In this paper, we investigate possible quantum ground 
states of the star-lattice antiferromagnet, including quan- 
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FIG. 1: (color online) Star lattice is shown with two inequiv- 
alent nearest neighbor spin exchange interactions Jt and Jd 
along the triangular and bridge links, denoted by the solid and 
dotted lines respectively. The rhombus enclosed by dashed 
lines corresponds to a unit cell with six sites labeled by the 
indices a to /. Here the 12-sided (blue) and 14-sided (red) 
loops are also shown. 



turn spin liquid phases, magnetically ordered states, and 
dimerized phases using a projective symmetry group 
analysis^^ and a large-iV Sp(iV) mean-field theory22i2i. 
We expect the quantum paramagnetic phases, namely 
the spin liquid and dimerized phases, may be relevant to 
a lower spin analog {e.g. spin-1/2 or spin-1) of the Iron 
Acetate, which is yet to be discovered. The magnetically 
ordered phases described in this work may directly be rel- 
evant to the low temperature ordered phase of the Iron 
Acetate. 

The star lattice can be regarded as a triangular Bravais 
lattice with a six-site basis and hence the unit cell con- 
tains six lattice sites as shown in Fig.(IT]). One can also 
view this lattice as a variant of the Kagome lattice in the 
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sense that additional lattice links between triangles of the 
Kagome lattice are introduced. This leads to two topo- 
logically in-equivalent nearest-neighbor spin exchange in- 
teractions: Jt along the triangular links and Jd along the 
bridge links that connect triangles. In the Heisenberg 
model with the antiferromagnetic sign for both Jd and 
Jt {Jt > 0, > 0), there is clearly a macroscopic degen- 
eracy of the classical ground states. Previous exact di- 
agonalization studies of the spin-1/2 nearest-neighbor an- 
tiferromagnetic Heisenberg model on the star lattice sug- 
gest that the ground state may be a dimerized state with 
dimers sitting on the bridge links for Jt — Jd and a 3-fold 
degenerate valence bond solid state when Jt > 1.3Jd^^ 
The finite size effect in these studies, however, makes it 
difficult to draw a definite conclusion. Various models in- 
cluding the quantum dimer model^^ and Kiteav model?- 
on the star lattice have also been studied recently. 

In this work, we provide systematic understanding of 
possible quantum spin liquid phases with bosonic spinous 
in the star-lattice antiferromagnet using a projective 
symmetry group analysis of the mean-field states in the 
Schwinger boson theory. The projective symmetry group 
is a powerful tool to classify all and only the physical 
spin liquid states without specifying a particular spin 
Hamiltonian. We also investigate how these spin liquid 
states may be related to the previously-identified dimer- 
ized phase a^^i^^ in the global phase diagram using a large- 
N Sp(A^) Schwinger boson mean field theory. 

Here we focus on the Z2 spin liquid phases on the 
star lattice, where Z2 represents a global pure gauge 
degree of freedom that leaves the mean-field states in- 
variant. It has been shown that such Z2 spin liquid 
states naturally arise in the Schwinger boson theory of 
the antiferromagnetic Heisenberg model on frustrated 
lattices. The projective symmetry group analysis leads 
to only a finite number of such Z2 spin liquid phases. If 
we further require the system to have only non-trivial 
nearest-neighbor valence bond amplitudes, there exist 
only two distinct Z2 (symmetric) spin liquid phases that 
preserve all the space group, spin rotation, and time 
reversal symmetries in contrast to the four symmetric 
Z2 spin liquid states on the Kagome lattice^l. These 
two states can also be distinguished by the "flux" en- 
closed in the 12-sided loop as shown in Fig.([T]), which 
is defined as the phase of the gauge-invariant product 
of the valence-bond-amplitudes Qij along the 12-sided 
loop, t.e. e = arg[Qi,2(-g^,3)Q3,4 • • • i-Qh,i)]^ The 
two Z2 spin liquid phases correspond to = and 
Q = n, respectively. The zero-flux state is an analog 
of the [0Hex,7rRhom] phase of the Kagome lattice^^. We 
study the spinon and spin-1 excitation spectra in the two 
spin liquid phases. In principle, the spin-1 excitation 
spectra can be measured by neutron scattering experi- 
ment to distinguish these two phases when an ambiguity 
as to the nature of the underlying quantum paramagnetic 
phase arises. 

Using the results above, we also investigate possi- 
ble magnetically ordered phases via the condensation of 



bosonic spinous in each spin liquid phase. The magnetic 
order arising from the zero- flux state has the magnetic or- 
dering wavevector q = -I- nn, | -I- mn) and (riTr, mn) 
with integers n, m. On the other hand, the magnetic 
ordering arising from the tt-Aux state has the ordering 
wavevector q = (0, 0) and docs not break translational 
symmetry. These results may directly be relevant to the 
low temperature magnetically ordered state of the Iron 
Acetate. The determination of the magnetic ordering 
wavevector would also tell us which spin liquid phase 
may close byi^ 

The relative stability of all these phases and the previ- 
ously studied dimerized state a^^i^^ is studied in a large- 
N Sp(iV) mean field theory of the nearest-neighbor ex- 
change model^Sii^ and the global phase diagram is ob- 
tained as a function of the effective spin magnitude 
K — 2SeS and Jt/Jd- The advantage of the large- 
Sp(A^) theory is that one can treat the magnetically or- 
dered and paramagnetic states on equal footing and the 
method is non-perturbative in the effective spin magni- 
tude, K — 2ScS- The results are shown in Fig.®. It 
is found that the zero-flux state is always energetically 
favorable over the 7r-flux state in the nearest-neighbor 
model. In contrast to Kagome lattice, the critical k be- 
yond which a magnetic order sets in, is much larger for 
the zero- flux state, i.e. Kc of the zero-flux phase can be 
as large as Kc '^-^ 5 while the largest Kc ~ 1-5 for the 7r-flux 
state. Kc 5 is an unusually large number because Kc 
is often smaller than unity in many cases. In fact, this 
is even larger than Kc ~ 2 of the [0Hex,7rRhom] phase 
of the Kagome lattice. This suggests that the zero-flux 
phase may exist even for relatively large spin (S > 1/2) 
system in an anisotropic limit. 

In the ultimate quantum limit, k <C 1, the dimerized 
state with the dimers sitting on the Jd bonds becomes 
the ground state when Jd > Jt while only the spin cor- 
relations on the triangles survives in the opposite limit, 
Jd < Jt (for the nearest-neighbor model),— The dimer- 
ized state for Jd > Jt is consistent with the previous 
numerical resul t^^'^'^ on the spin-1/2 nearest-neighbor 
Heisenberg model. The nature of the dimerized state for 
Jd < Jt cannot clearly be identified in the present work 
because it requires further analysis of the 1/A^ fluctua- 
tion corrections.^*'^^ We emphasize, however, that the 
phase boundaries of various phases may look different in 
the physical N = 1 limit, so the phase diagram obtained 
in the large- limit should be taken with a grain of salt. 
Further, it is possible that the inclusion of other spin in- 
teractions may favor the spin liquid over the dimerized 
states even deep inside the quantum regime k <^ 1. The 
nature of the transitions between various phases in the 
phase diagram is also discussed in the main text of the 
paper. 

The rest of the paper is organized as follows. In Sec.HIl 
we briefly review an Sp(A) mean field theory of the anti- 
ferromagnetic Heisenberg model. In Sec. IIIIl the concept 
of projective symmetry group (PSG) is introduced. Here, 
the PSG on the star lattice is applied to the Sp(A^) mean 
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field theory and is used to analyze possible Zi spin liq- 
uid phases. In Sec. llVi various physical properties of 
two distinct Z2 spin liquid phases are explained and the 
mean-field phase diagram including dimerized and mag- 
netically ordered phases (for the nearest-neighbor Hcisen- 
berg model) is obtained. We discuss the implications of 
our results to theory and experiment in Sec. |Vl Details 
of the derivation of the PSG for the star lattice are given 
in Appendix [XI 

II. AN SP(Ar) GENERALIZATION OF THE 
HEISENBERG MODEL 

To investigate possible magnetically ordered and quan- 
tum paramagnetic states in the quantum antiferromag- 
netic Heisenberg model, H — Jij • Sj, it is useful 
to generalize the usual spin-SU(2) Heisenberg model to 
an Sp(N) model.2"'32 

Let us start with the Schwinger boson representation 
of the spin operator Si = h\^Uaphifi^ where a,/3 =t, i, <J 
are Pauli matrices, hia are canonical boson operators and 
a sum over repeated a indices is assumed. Note that we 
need to impose the constraint rif, = h\j3ia = 2S to satisfy 
the spin commutation relations, where S is the spin quan- 
tum number. A generalized model is obtained by intro- 
ducing N flavors of such bosons on each site. In order to 
keep the physical Hilbert space of spins, a constraint on 
the number of bosons given by ni, = &|™&^ — 2ScS — 
where m — 1,...,N must be imposed at each site. Note 
that = 1 corresponds to the physical limit Sp(l) = 
SU(2). The action of the corresponding Sp(A^) general- 
ized model is then given by 

S = J dribZdrbZ - ^A,,A,, + MbZJZ - rib)}, (1) 

where Aij = e^p Smm'bZbfp [eap Smm' is the Sp(A^) gen- 
eralized antisymmetric tensor of SU(2)) and the chemical 
potential Xi keeps the number of bosons fixed to — kN 
at every site. The mean-field action is then obtained by 
decoupling the quartic boson interaction in S using the 
Hubbard- Stratonovich fields Qij — —Qji directed along 
the lattice links so that one obtains Qij = {Aij)/N at 
the saddle point. The mean field solution becomes ex- 
act in the large- A^ limit where A^ — > cx) is taken while 
= nii/N is fixed. We also introduce the parametriza- 

tion 6™ = ( ^/Nxia 6™ ) where rh = 2, ...,N to allow 
for the possibility of long-range order that occurs when 
Xia 0. Consequently, after integrating over the bosons, 
we obtain the effective action at the large- A^ saddle point 
(or the mean-field free energy) at zero temperature: 

S.s/N = J2:l^{\Q,^\^ - Q^^{e^pxZx*^) + c.c.) 

+ A5](|:e,„P-(k + 1)) + ^c.^(Q,A), (2) 



where ujf^{Q,X) are the eigenvalues of the mean- field 
Hamiltonian. Note that the chemical potential is now 
taken to be uniform since each site has the same number 
of nearest neighbor links. In general, magnetic ordering 
Xia 7^ occurs in the semiclassical limit at larger k while 
quantum paramagnetic phases are obtained when k is 
small. In this work, we will study possible phases of such 
a model as a function of k and Jd/ Jt at zero temperature. 

III. PROJECTIVE SYMMETRIC GROUP 
ANALYSIS OF Z2 SPIN LIQUID PHASES ON 
THE STAR LATTICE 

We are interested in the classification of Schwinger bo- 
son mean-field states, especially the spin liquid phases 
that do not break any underlying microscopic symmetry. 
Such symmetric spin liquid phases can be classified using 
a projective symmetry group analysis, which was pre- 
viously used for the fermion^ and boson^i mean-field 
states for different lattices. For our purpose, the ap- 
proach taken by Wang and Vishwanath^i would be the 
most relevant. This analysis allows us to identify all the 
physically realizable spin liquid phases, independent of 
particular microscopic Hamiltonians. In this section, we 
only consider the physical A^ = 1 case of the Schwinger 
boson theory and note that distinct spin liquid phases 
may be realized as ground states in different models. 

In the Schwinger boson theory, the effective action and 
all physical observables are invariant under the following 
local U{1) transformation for the boson and mean- field 
ansatz Qij: 

^ e-*'^(')-^^(^')g,y, (3) 

where (f)(i) is an arbitrary real field defined on the un- 
derlying lattice site. Therefore, two mean-field ansatze 
that are related by such a transformation correspond to 
the same physical state after projection (onto the physi- 
cal Hilbert space). An important point is that symmetry 
transformations (such as space group, spin rotation, and 
time reversal) may return a mean-field ansatz to a U{1) 
transformed form and in this case the transformed ansatz 
would correspond to the same physical state. Thus when 
we consider the mean-field ansatz that preserves all the 
microscopic symmetries, we need to include the U{1) 
transformations. The main idea of the projective symme- 
try group analysis is that a mean-field ansatz preserves 
all the symmetries not only when the ansatz is invariant 
under the symmetry transformation X, but also when it 
is invariant under the symmetry transformation X fol- 
lowed by a local U{1) gauge transformation, Gx, i.e. 

{Gx-X)Q,,=Q,j. (4) 

Thus, for example, physically distinct symmetric spin liq- 
uid phases can be characterized by different allowed sets 
of combined transformations, {Gx ■ X}. 
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In addition, there also exist pure local gauge transfor- 
mations that leave the mean- field ansatz invariant. The 
set of such elements is called the invariant gauge group 
(IGG). The IGG is a subgroup of the underlying C/(l) 
symmetry and is not a physical symmetry since it is not 
related to any microscopic symmetry. On the other hand, 
the IGG becomes the emergent gauge symmetry in the 
deconfined phase that describes the relevant spin liquid 
phases.-^ Therefore, it is important to identify the IGG 
of a mean-field ansatz. The IGG and the set {Gx'X} to- 
gether form the PSG. This PSG then can be used to clas- 
sify the physically distinct spin liquid phases that have 
the same microscopic symmetries. 

It can be readily seen that the IGG of the mean-field 
ansatz Qij on the star lattice (or on any frustrated lat- 
tice) is Z2- The two elements of the IGG are the identity 
operation 1 and the IGG generator —1: bia — > —hia- The 
spin liquid phases that are characterized by a Z2 IGG are 
called Z2 spin liquid states. Here we would like to clas- 
sify possible symmetric Z2 spin liquid phases on the star 
lattice using the PSG. 



A. Algebraic constraints on the PSG 

We would like to find all the constraints on the PSG 
that preserve microscopic symmetries such as the space 
group, spin rotation, and time reversal. The Schwinger 
boson mean-field Hamiltonian is explicitly spin-rotation 
invariant. Here we concentrate on the space group op- 
erations such as translations and point group operations 
for the star lattice. The time reversal operation will be 
considered later. For each space group operation, the 
allowed gauge transformations in the PSG are strongly 
constrained by certain algebraic relations among symme- 
try group elements. Thus we first need to derive all the 
algebraic relations (so-called algebraic PSGs) and inves- 
tigate the solutions which provide all the symmetric spin 
liquid phases. 

In the case of the star lattice, the underlying Bravais 
lattice is a triangular lattice and the space group contains 
two translations Ti and T2 defined by the basis vectors 
ei and 62 in Fig. ([T|) , one reflection a along the diagonal, 
and the 60° rotation R about a lattice site. 

The translation operation, T^, shifts the lattice by one 
unit cell along e^. 



sublattice indices. 



Ti : {ri,r2,as) 
T2 ■■ (ri,r2,as) 



(ri + l,r2,as), 
(ri,r2 -I- I, as), 



(5a) 
(5b) 



where r = (ri,r2,Q;<;) represents the location of a lattice 
site. Here (ri,r2) with integers ri and r2 denotes the 
coordinate of a unit cell (R = riCi -I- r2e2) and as € 
{a, 6, c, d, e, /} labels the six sites within each unit cell 
(see Fig.(IT])). Reflection cr, however, interchanges the 



a 
a 
a 
a 
a 
a 



iri,r2,a) 
: {ri,r2,b) 
: {ri,r2,c) 
{ri,r2,d) 
{ri,r2,e) 
{ri,r2,f) 



{r2,ri,e), 
{r2,ri,f), 
{r2,ri,d), 
{r2,ri,c), 
{r2,ri,a), 
{r2,ri,b). 



(6a) 
(6b) 
(6c) 
(6d) 
(6e) 
(6f) 



Rotation, R, also leaves the 6 sublattice indices inter- 
changed, 



R : 


(ri,r2,a) - 


Hn 


- r2,ri,d), 


(7a) 


R : 


: (ri,r2,5) - 


-in 


-r2,ri,f), 


(7b) 


R : 


: {ri,r2,c) - 


-in 


- r2,ri,e), 


(7c) 


R : 


(ri,r2,d) - 


-in 


-r2- l,ri,6). 


(7d) 


R : 


(ri,r2,e) - 


-in 


- r2 - l,ri,o). 


(7e) 


R : 


{ri,r2j) - 


-in 


- r2 - l,ri,c). 


(7f) 



One can define the corresponding gauge transforma- 
tion Gx for each symmetry operation X — Ti,T2,(J, R: 



Gx-W 



(8) 



The PSG is then generated by combining the Z2 IGG and 
the operations Gx-X. We follow Ref|2l| for the derivation 
of the algebraic relations between the PSG elements that 
would impose strong constraints on possible spin liquid 
phases and repeat some of the basic arguments here for 
completeness. 

In order to see how the structure of the space group 
imposes the constraints on the PSG, let us first consider 
the symmetry operation T^^T2TiT2^ which is the iden- 
tity operation: 



^T2TiT^ ^ : {ri,r2,as) ^ (ri,r2,as). 



(9) 



on every site. It means that the corresponding PSG op- 
erations should leave the mean-field ansatz unchanged, 
namely, 

(Gt.Ti)-^ {Gt,T2) (Gt.Ti) {GT,T2r' e IGG. (10) 

The PSG operation above can be rewritten as 
[T^\Gt,)-'Ti] ■ [Tf 1Gt,Ti] • [iTr'T2GTATr'T2)-'] ■ 
[Gx-i) ^- Since the gauge transformation F ^Gx^^ with 
a space group operation Y acting on a site r would gen- 
erate a phase ^^(^(r)) in the boson field, the equation 
above leads to the following constraint 

- (/.T,(r) + 0TjT2-'Ti(r)] 

+0TjTi(r)] -(/.Tjri(r)] =pi7r, (11) 

where pi = 0, 1 comes from the fact that there are two 
elements, 1 and —1 in the IGG. 

There are additional constraint equations from other 
independent space group operations. More specifically. 
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together with Eq. ([9]), the following symmetry relations 
need to be taken into account: 



T2TI 


= TiT2, 


(12a) 




= O-T'2, 


(12b) 


a' 


= 1, 


(12c) 


T1RT2 




(12d) 


T2R 


= RT1T2, 


(12e) 


aRaR 


= 1, 


(12f) 


R' 


= 1. 


(12g) 



It can be shown that all other relations can be derived 
from them. In the Appendix O we solve all the algebraic 
constraints derived from these relations. The general so- 
lution of the algebraic PSG for the star lattice is found 
as follows: 



^ f 




FIG. 2: (color online) In each unit cell, there are 9 dif- 
ferent nearest-neighbor valence-bond amplitude, Qij, which 
can be classified into two groups, {Ci, C2, C3, C4, C5, Ce} and 
{Di,D2,D3}. 



4>Ti{ri,r2,as) = 0, 
4>T2{ri,r2,as) =pi7rr'i, 

4'o-{ri,r2,as) = Pi7rrir2 



2 ' 



4>R{ri,r2,as) = pinrir2 + ^r-2(r2 - 1) 



(13a) 
(13b) 

(13c) 
(13d) 



where Pi, p2,P3,P4 G {0,1}. Here, Sa,j = 1 when = / 
and zero otherwise. Thus there exist 16 possible symmet- 
ric spin liquid phases. Notice that, not surprisingly, the 
solutions for the translation and reflection are the same 
as those in the triangular lattice. The solution for the 
rotation, however, has a more complex structure. The 
general solution, except for the rotation, looks similar to 
the one in the triangular and Kagome lattice cases where 
the underlying Bravais lattice is the same but the number 
of sites per unit cell is different. However, we will show 
later that once we consider mean-field ansatz with nonva- 
nishing nearest- neighbor bond amplitudes, Qij, only two 
of these spin liquid phases survive and the properties of 
these states are different from the allowed states in the 
other cases. 

To summarize this section, we solve the algebraic PSG 
constraint equations for the star lattice and find that 
P1jP2,P3,P4 & {0, 1} are required to classify all distinct 
symmetric Z2 spin liquid states that preserve all space 
group symmetries. In the next section, we show that if 
the nearest-neighbor bond amplitudes Qij are nonzero 
and time reversal invariance is required, there are addi- 
tional constraints on these parameters. At a result, we 
will see that there exist only two symmetric Z2 spin liquid 
states with distinct PSG or quantum order. 



B. Z2 spin liquid states with nonvanishing 
nearest-neighbor bond ampHtudes 

In the star lattice, there are 9 different nearest- 
neighbor bond amplitudes Qij in the unit cell and we 



label them by {Ci, . . . , Cg} and {Di, D2, D3} that cor- 
respond to the triangular and bridge links, respectively 
(see Fig. ([2])). If we assume that all of them are nonzero, 
there are more constraints on the PSG structure. 

First, we consider what happens to the amplitude 
£'3(0,0) = Q(o,o,c)-f(o,o,d) (other amplitudes are de- 
fined in a similar fashion) under reflection a. From 
Eq.®, we infer £'3(0,0) ^ -£13(0,0), then from the 
definition of the PSG in Eq.Q, we get the constraint 
0^(0, 0,c) + 0^(0, 0,d) = TT (mod 2n). This leads to 
P2 = 1. 

Another constraint can be obtained by comparing the 
60° rotation R, and the refiection a on Ci(0, 0), 

{Gr ■ i?)Ci(0, 0) - (G, • a)Ci(0, 0). (14) 

R 



Since Ci(0,0) ^ C4(0,0) and Ci(0,0) 
imposes the condition 



-6*4(0, 0), it 



(15) 



where (f>'^ = (l)x{0,0,a) for X E {(t,R}. This implies 
that P3 = in the PSG. 

Finally, we consider the constraint by 180° rotation R^, 
and the translation (£1)^^ on the bridge link, £'i(0, 0), 



{Gr - RfDi{0,0) = iGT,Ti)-^Di{0,0). 



(16) 



Here, £'i(0,0) 



-£'i(-l,0) and £ii(0,0) 



£'i(— 1,0), leading to the constraint, 

(^^(0,0) -t- (/.^X0,0)-f(/.^,(0,0) + 4,(-l,0) 



(17) 



which implies — 1 in the PSG. 

Thus, by assuming nonvanishing nearest-neighbor am- 
plitudes, the parameters which characterize the PSG 
structure {pi,P2,P3,P4} become {pi,l,0, 1}. There are 
only two distinct symmetric Z2 spin liquids correspond- 
ing to pi = 0,1. If the time reversal symmetry is 
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^ 
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FIG. 3: (color online) The arrow representation of the mean- 
field ansatz for the pi — 1 state. The area enclosed by the 
dashed lines is the corresponding unit cell with 12 sites. Note 
that the directed link Qbe is staggered along the (0, 1) direc- 
tion. 



FIG. 4: (color online) The arrow representation of the mean- 
field ansatz for the pi — state. The arrow from the site i to 
site j means Qij > 0. The area enclosed by the dashed lines 
is the corresponding unit cell with 6 sites. 



preserved, all the amplitudes Qij can be taken to be 
real. Moreover, Qij — ~Qji that follows from the self- 
consistent equation. Hence the mean field ansatz Qij 
can be depicted by an arrow representation in which the 
arrow denotes the direction where Qij is taken to be pos- 
itive. The arrow representations for the two distinct spin 
liquid phases are shown in Fig. ^ and (0]) respectively. 
The pi = \ state can be described by a unit cell with 
12 sites while pi = state has a unit cell with 6 sites. 
Both of them are characterized by two kinds of nearest- 
neighbor bond amplitudes Qd and Qt, which refer to the 
absolute values, \Qij\, of the amplitudes on the bridge 
and triangular links, respectively. 

These two states can also be distinguished by the 
"flux" enclosed in a length-12 polygon^^, which is de- 
fined as the phase Q of the gauge-invariant product of the 
nearest-neighbor amplitudes along the 12-length loop: 

Qili2 {~Qi2i3) ' ' ' {^Qil2il ) ~ QdQt ^ ~ i (18) 

where {«i,...,«i2} label the 12 sites along a lenght-12 
loop as shown in Fig. H]). The "flux" 9 = for pi — 1 
state (zero-flux state) while Q = n for pi = state (tt- 
flux state). Hence, the two states are clearly not gauge- 
equivalent and can be identified by the "flux" . The phys- 
ical properties of these spin liquid states and how they 
arise in the large- iV Sp(A^) mean-field theory will be dis- 
cussed in the next section. 



IV. LARGE-iV SP{N) MEAN-FIELD PHASE 
DIAGRAM 

In this section, we analyze the large- TV mean-field the- 
ory of the Sp(iV)-generalized Heisenberg model with the 
nearest-neighbor exchange interactions. In particular, 
we investigate the phase diagram as a function of Jd/ Jt 
and K = 25*05. In the previous section, we demonstrate 



that there are only two possible symmetric spin liquid 
phases, as shown in Fig. ([2]) and Fig.(|3]), when the nearest- 
neighbor bond amplitudes are finite and they correspond 
to pi = 1,0 in the PSG description respectively. The 
strength of the nearest-neighbor bond amplitudes, Qd 
and Qt, and the spinon condensate density be 
determined by minimizing the effective action, Eq. 

In the Sp(iV)-generalized Heisenberg model, it has 
been known that the spin liquid state with the small- 
est "flux" has the lowest energy. Thus, not surprisingly, 
we find that the zero-flux state {pi = 1) is always lower 
in energy in the relevant part of the phase diagram. On 
the other hand, it is also known that a ring-exchange or 
the next-nearest-neighbor spin interactions can lower the 
energy of a spin liquid state with a larger flux^^. Hence, 
it is useful to analyze the phase diagram of the Heisen- 
berg model with respect to both of the two spin liquid 
states. The mean-field phase diagram for the nearest- 
neighbor model is shown in Fig.(l5|), where the 7r-flux state 
never appears as the true ground state. Anticipating that 
other types of interactions can favor the tt-Aux state, we 
also compute the mean-field phase diagram by artificially 
suppressing the zero-flux state (as if an appropriate ad- 
ditional interaction may punish the zero-flux state) . The 
resulting phase diagram is shown in Fig.®. Notice that 
the magnetically ordered phases in the large-K limit in 
Fig. ([5]) and Fig. ([6]) are descendants of the zero- flux and 
TT-flux phases in the sense that the condensation of the 
spinous in each spin liquid state leads to these magnet- 
ically ordered phases. On the other hand, the ground 
states in the k <C 1 limit are typically dimerized or va- 
lence bond crystal phases. Physical properties of all the 
phases present in the phase diagram and the interplay 
between them are described as follows. 
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FIG. 5: (color online) Large-A'^ mean-field phase diagram for 
the Sp(A^) generalized nearest-neighbor Heisenberg model. 
Notice that only the zero-flux state occurs as a stable spin 
liquid state in the phase diagram. 



[0Hex,7rRhoni] spin liquid state identified in the Kagome 
lattice.^^ 

The spinon spectrum can be computed using the 
Sp(iV) theory described in section |TT1 However, 
the single-spinon spectrum is not gauge-invariant and 
the gauge-invariant two-spinon (spinon- antispinon) spec- 
trum is physically more relevant. Here, we present the 
lower-edge of the two-spinon spectrum, which is given by 

S(2)(q) =min{eq_p + ep}, (19) 
p 

where Cp is the single-spinon spectrum. The single- 
spinon spectrum and the lower edge of the two-spinon 
spectrum are shown in Fig. ([7]) which are similar to that 
of [0Hex,7rRhom] spin liquid phase obtained in Kagome 
latticcj^ The minima of two spinon spectrum are given 
by q = ±(7r/3 -|- n7r,7r/3 -|- m7r) and (n7r,rn7r) with in- 
teger n, m. As At increases, the minimum of the spinon 
spectrum decreases and the spectrum becomes gapless 
at «; = Kc, where Kc = i^c{Jd/ Jt) varies depending on 
the value of Jaj Jt- Possible magnetically ordered phases 
arising when k > Kc — Kc{Jd/Jt) are characterized by 
the ordering wavevectors q = ±(7r/3 -t- n7r,7r/3 -I- m7r) 
and (riTT, mn) with integers n, m. 
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FIG. 6: (color online) Large- A'^ mean-field phase diagram with 
the zero-flux state being artificially suppressed (as if an ad- 
ditional interaction punishes the zero-flux state). The vr-flux 
state is then the spin liquid state competing with the dimer- 
ized states. 



B. TT-flux spin liquid state and the related 
magnetically ordered phase 

The TT-flux spin liquid state is characterized by pi = 
in the PSG description and the mean-field ansatz (in 
the arrow representation) is depicted in Fig.Q. The 
ansatz is described by a 6-site unit cell. It has tt flux 
in the 12-sided and zero flux in the 14-sided polygon as 
shown in Fig. ([T]). Both single- and two- spinon spec- 
trum are shown in Fig. ([5]) . The two-spinon spectrum has 
the global minimum at the center of the Brillouin zone 
q = (0, 0). It is an analogous state of the Qi = Q2 state 
identified in the Kagome lattice.— 1^ The condensation 
of the spinous leads to the q = magnetically ordered 
ground state which is translationally invariant. Since the 
two-spinon spectrum of the tt-Aux state is quite differ- 
ent from that of the zero-flux state, the two states can 
be distinguished by neutron scattering experiment that 
measures spin-1 excitations. 



A. zero-flux spin liquid state and the related 
magnetically ordered phase 

The zero-flux spin liquid state corresponds to pi = 1 in 
the PSG description and the mean-field ansatz is shown 
in Fig. ([3]). There are 12 sites per unit cell in the mean- 
field ansatz. It has zero flux in the 12-sided and tt-Hux 
in the 14-sided polygon (see Fig.([T])). Hence, it has the 
lowest energy in the pure Heisenberg model according 
to the flux expulsion argument by Tchernyshyov et ali^ 
in the small k limit. It is an analogous state of the 



C. Dimerized-d state 

In the regime Jt < Jd, the ground state is a dimer- 
ized state for sufficiently small k, where all the triangular 
bond amplitudes vanish (Qt = 0) and only the amplitude 
on the bridge links, Qd, is finite. We call this state as the 
dimerized-d state. Notice that this state does not break 
any translational symmetry. This is an isolated-dimer 
state and there is a gap ~ Jd for the spin-1 excitations. 
The presence of this ground state in the small k limit 
can be proven using the small k expansion^^ of the ef- 
fective action SoS in Eq.([2) for paramagnetic solutions 
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FIG. 7: Contour plots of the single-spinon (left) spectrum and 
the lower edge of the two-spinon/spinon-antispinon (right) 
spectrum of the zero-flux state (pi = 1). Darker area means 
lower energy. The hexagon represents the Brillouin zone. 




FIG. 8: Contour plots of the single-spinon (left) spectrum and 
the lower edge of the two-spinon/spinon-antispinon (right) 
spectrum of the 7r-fiux state (pi = 0). Darker area means 
lower energy. The hexagon represents the Brillouin zone. 



{xia — 0). Such a perturbative expansion of SeS in k 
leads to 



Pi 

1 

R 



P2 



2RPi 



(20) 



where Ns is the number of lattice sites, R = —{JdQd + 
2JtQj)/2, and P„ is the "flux operator" defined on the 
loop of length 2n, 

loop 



= + 2j2Q2)/4 and 

64Qt + j!Qj)/16. 



In particular, Pi 

When Jt < Jd, we find that Qt = Q can minimize the 
effective action Eq.([2|) for k < and the critical kJ? is 



^I - 2u 
'4w - I' 



(22) 



where u = Jt/{Jt + Jd) < 1/2. This result is asymptoti- 
cally correct near w = 1/2 where = 0. When k > k^, 
the spin liquid phases become more stable as far as n is 
not too large. 



D. Dimerized-t state 

When Jt > Jd, there is another dimerized mean- field 
state for sufficiently small n. In this state, all the ampli- 
tudes on the bridge links are zero {Qd = 0) while the am- 
plitudes on the triangular links are finite. The mean-field 
dimerized-t state, therefore, does not break any transla- 
tional symmetry. Again, the presence of this state can be 
seen from the small n expansion of the effective action. 
That is, = is the solution for the minimum effective 
action as far as k < k* where ni is 



kI = 4- 



,2u- 1 



8m 



(23) 



When Hi> the spin liquid phases become more stable 
for not-too-large k. 



E. Further discussions on the phase diagram 

Notice that, at the isotropic point, Jt = Jd, a spin liq- 
uid phase becomes the ground state even in the small n 
limit, where the amplitudes on both the bridge and tri- 
angular links are nonvanishing and identical (see Fig.® 
and Fig. ([5])). However, it turns out that the amplitudes 
on the bridge links become stronger than the ones on 
the triangular links as k increases. This indicates a ten- 
dency to form local singlets on the bridge links, which 
may be consistent with the results of the exact diagonal- 
ization study by Richter et alj^ for the spin- 1/2 isotropic 
model. More precise determination of the ground state 
at the isotropic point, therefore, requires the analysis of 
1/N fluctuations about the large- TV mean-field state. 

The spin- 1/2 anisotropic model with Jd ^ Jt was pre- 
viously studied by exact diagonalization restricted to the 
dimer Hilbert spacc;^ It was found that the dimerized- 
d state is the stable ground state for Jt < 1-3 Jd- On 
the other hand, for the opposite limit Jt > 1.3Jd, it was 
suggested that the ground state may be a valence bond 
crystal made of a lattice of 18-sided plaquette-valence- 
bond structure, which breaks the translational symme- 
try and is three-fold degeneratci^ Our mean-field theory 
cannot capture possible presence of this state since such 
a state would arise via fiuctuations beyond the large-A^ 
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limit. ^^'^^ Thus the incorporation of relevant quantum 
fluctuations or another method is necessary to pin down 
the ultimate fate of the mean-field dimerized-t state. 

As discussed in the previous sections, the mean- field 
transition from the spin liquid phases to magnetically 
ordered phases is continuous since it is described by the 
condensation of bosonic spinous. When Jd and Jt are not 
very different from each other, there is no direct transi- 
tion from the dimerized state to magnetically ordered 
phases. On the other hand, in the extreme anisotropic 
limits, Jd ^ Jt or Jd <C Jt, there is a possibility in 
the TT-flux phase diagram that there is a direct transi- 
tion from a dimerized state to a magnetically ordered 
state - the energies of all the states become very close 
near the phase boundary so that our mean-field calcula- 
tion could not determine whether there is a direct tran- 
sition or one still has to go through a spin liquid phase 
in the extreme anisotropic cases. If a direct transition 
is possible, such a transition does not have to be always 
first order because the dimerized-d state, for example, 
does not break any spatial symmetry. The transition 
from the spin liquid phases to dimerized states (with 
isolated dimers) is continuous and is described by the 
confinement-deconfinement transition of spinons in a Z2 
gauge theory^. 



V. DISCUSSION 

In the large- mean-field phase diagram of the star- 
lattice Heisenberg model, it is found that the two possi- 
ble Z2 spin liquid phases can exist even for k > 1 (this 
corresponds to 5 > 1/2 in the physical A 1 limit) 
in some parts of the phase diagram. This is highly un- 
usual given that most of the previous studies on other 
lattice models obtain Kc < 1. While the phase bound- 
aries in the large-A mean-field theory may change as A^ 
gets smaller, this is certainly an encouraging sign. No- 
tice, for example, that, when k = 3 (S'cff — 3/2), as 
Jt/{Jd + Jt) changes from zero to one, one encounters 
the dimerized-d state, zero-fiux spin liquid, magnetically 
ordered state, zero-fiux state and finally the dimerized-t 
state in the mean-field phase diagram (see Fig. ([6])). 

More generally, the zero-fiux phase is stable up to a 
relatively large n = 2Scfi'- ~ 2 at the uniform point 
{Jd = Jt)- It is close to the Kc obtained in [0IIex,7rRhom] 
spin liquid phase in Kagome lattice, which has the simi- 
lar two-spinon spectrumi^i The Kc gets even larger in the 
anisotropic limit, Jt ^ Jd or Jt Jd- The largest Kc we 
obtain is ~ 5 in a very anisotropic limit, Jd/ Jt ~ 9. 
On the other hand, in such an anisotropic limit, the re- 
gion in the phase diagram where the spin liquid state is 
stable becomes smaller. This suggests that moderately 
anisotropic exchange interactions may favor the realiza- 
tion of spin liquid phases. 

It is also worthwhile to notice that the 7r-flux state has 
a relatively small Kc, in contrast to a similar study of 
the Kagome lattice model^i. As emphasized in Refl2ll. 



the spin liquid phases with finite fiux may be stabilized 
by a ring exchange term that arise near a metal-insulator 
transition where charge fluctuations become important 
Thus the star-lattice antiferromagnetic insulator at the 
verge of becoming a metal may be a good candidate for 
the realization of the 7r-fiux spin liquid state. 

Finally, as far as we know, the only known realiza- 
tion of the star-lattice antiferromagnet is the polymeric 
Iron(III) Acetate [Fe3(/X3-0)(/x-OAc)6(H20)3] [Fe3(At3- 
0)(/i-OAc)7.5]2-7H20^ The spin of the magnetic Fe"^ 
ion is 5 — 5/2 and the Curie- Weiss temperature de- 
termined from the high temperature susceptibility is 
©cw = — 581K. This material undergoes a magnetic 
transition at Tjv ^ 4.5K, leading to a large frustration 
parameter, / — |Ocwl/TV = 129. The magnetic order- 
ing patterns predicted in the large k, limit of the large-A^ 
mean-field theory may directly be relevant to the low 
temperature phase of this system. Once the magnetic 
ordering pattern is determined by neutron scattering ex- 
periment or other means, one may be able to determine 
whether the material is close to the zero-flux or 7r-flux 
spin liquid phases because they are related to different 
magnetically ordered phases 1^ The large frustration pa- 
rameter observed in this material and the large Kc from 
our mean-fleld theory point to the possibility that a spin- 
1/2 or even a spin-1 analog of this material may support 
one of the spin liquid phases discussed in this work. 
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APPENDIX A: ALGEBRAIC PSG FOR THE 
STAR LATTICE 

Here we generalize the method developed in the Refl2ll 
to derive the allowed PSGs for the star lattice. The 
strategy is to find all the constraints on the PSGs and 
use them to identify the general solution. We first con- 
sider how PSG transforms under an arbitrary U(l) gauge 
transformation G = 6**^° on the ansatz, Qij GQij. 
The transformed ansatz should now be invariant under 
GGxAG^i = (GGxXG-^X-^) X. Thus Gx can be 
replaced by GGxXG^^X^^ . This means that the phase 
transforms as 

cj>x{r) -> 0G(r) + 0x(r) - <^g (^-^(r)) . (Al) 

Here r = (ri,r2,as) with integers ri and r2 which label 
the location of the unit cell, R — riei + r2e2, and G 
{a, 6, c, d, e, /} label the six sites in a unit cell. 

To simplify the expressions of the PSG, one can choose 
(^Ti (j"!, ''2, cks) = and (0, ''2, Q^s) = (independent 
of the sublattice index as), by using a gauge degree of 
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freedom or the gauge transformation Gq via 

ri r2 
</'Go(^l,r2) = - J2 <^T,(^^2)- J2 '^T.(0,j) (A2) 



on all sublatticcs . Here and correspond to the 
phases for an arbitrary initial choice for Gti and ■ 
Notice that the gauge transformation Go is well-defined 
only on the lattice with open boundary condition. Extra 
care is necessary for periodic boundary condition. We 
assume open boundary condition throughout the analysis 
for simplicity. 

Now we would like to find the PSGs which satisfy 
all the algebraic constraints in Eg. p^ . First, we con- 
sider the constraint arising from the symmetry relation, 
TiTs =r2Ti, in Eq.ini), 



(A3) 



where we introduce two forward difference operators Ai 
and A2, defined as Ai/(ri,r2) = f{ri + l,r2) - f{ri,r2) 
and A2/(ri,r2) = f{ri,r2 + l)-f{ri,r2). Here pi 0, 1 
is a site-independent integer corresponding to the two 
elements in IGG. The solution for then is given by 



4'T2iri,r2,as) =_pi7rri. 



(A4) 



which is independent of a^. 

Next, we consider the relation, aT2 = Tia and aTi = 
T2(7. The constraints arising from these relations are 

^i<Pa{ri,r2,as) =p'2TT+piTTr2, (A5a) 
^2(t)a{ri,r2,as) =p'3TT+piTTri, (A5b) 

after substituting Eq. (|A4|) for 0T2(r) and P2,P3 — 0, 1. 
The solution to these equations is 

0cr(ri,r2,as) = C + p'2'^'ri + p'^7rr2 +Pi7rrir2, (A6) 

where 0"= = 0ct(O, 0, as). Herep2jP3 0"° can further 
be determined by additional symmetry relations. 
Notice that, from a a — I, we have 

(t>cr (ri , r2 , a) + {r2 , ri , e) = p27r, (A7a) 
(I>a{ri,r2,b) + (f)cr{r2,ri, f) =P27r, (A7b) 
0cr {ri , r2 , c) + {r2 ,ri,d) = p2Tr. (A7c) 

Again p2 = 0, 1 correspond to the two elements of the 
IGG, which is sublattice-independent. Using Ea. (jA6p . 
we get the following constraint equation. 

C+C -P27r+(ri+r2)(p'2+p:iK (A8) 

and hence P2 — P3 (modulo 2) because the left-hand-side 
is independent of ri, r2- To determine p'2, consider the 
gauge transformation Gi, 



One can show that the gauge transformation Gi does not 
modify Gti and Gts , but G^ changes as follows; 

(t)air) 0^(r) = + {p'2 + l)7r(ri +r2) +pi7rrir2. 

p(j = (modulo 2) 



Therefore we can always assume p'2 
and this leads to 



r{ri,r2,as) = C +Pi7rrir2. 



(AlO) 



To determine , we consider the following gauge trans- 
formation, 



h{ri,r2,a) = 0o, 
G2 : ( (f>2{ri,r2,e) = -(/>o, 
<p2{ri,r2,as) = 



{a,e}. 



(All) 



where 0o is an arbitrary constant. Again, this transfor- 
mation does not change Gti and Gts , but modifies G^ (a) 
(Go- acting on the sublattice site a) and Ga{e) as follows: 

C ^ C + , (A12) 
</.^ , (A13) 

C ^ C'' as^{a,e}. (A14) 

By choosing 0o = i('/'CT ~ 0^): can make the phases 
(/)° and 0^ to be equal, i.e. (j)'^ = (j)'^ = p2'^/2. Similar 
gauge transformations, G2 and G2 , can be used for {6, /} 
and {c, d} pairs such that all the phases, , are chosen 
to be P2Tt/2. The resulting PSG for the reflection, Ga, is 
then given by 

4'cr{ri,r2,as) ^ Pinrir2 + —, (A15) 

which is independent of the sublattice index, ag. 

Now let us consider algebraic constraints arising from 
T1RT2 = R and RT1T2 = T2R: 

Ai(t>Riri,r2,as) =piTrr2+p'iTr, (A16a) 
A2 0_R(ri,r2,as) = Pi7r(ri - r2 - 1) +P47r, (A16b) 

using the solution of and . Here, ^4,^4 = 0, 1 can 
be fixed by using additional algebraic constraints and the 
gauge degrees of freedom. The general solution of the 
difference equations for (pnir) is found as 



(l)Riri,r2,as) 



Pinrir2 +p^Kri 

PlTT 



P47rr2 



-r2ir2 - 1) + rn , 



(A17) 



where (^^° = 



0fl'(0, 0, Qfs). To determine p'^, we consider 
the relation RcrRcr = I with Eq. ljAlSP and Eq. (|A17p . 
which results in, for example. 



2rR+p'Mr2-l) 



PaT^ 



(A18) 



for p3 = 0, 1 and hence it implies p'^ ~ (modulo 2). Sim- 
ilarly, we can obtain the following set of coupled equa- 
tions. 



Gi : (l)Giiri,r2,as) = nn. 



(A9) 



R 
+ <t>'R 
^^R 



^'r 



: p37r. 



(Al9a) 
(A19b) 
(A19c) 
(A19d) 
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Unlike the case of the Kagome lattice, there is no further 
constraint imposed by the relation aRaR — I. To fix 
the gauge degree of freedom for (j)'^' , we consider another 
gauge transformation, 



G4 = 



(j)4{ri,r2,a) 
(j)4{ri,r2,as) 



(A20) 



otherwise. 



This gauge transformation does not modify Gti , and 
Gcr, but changes (j)^: 



A - 


> 4 + 




(A21) 


fR - 


> ^R- 




(A22) 


fR - 


> K- 




(A23) 


fR - 


. rR + 




(A24) 




' Vr 


otherwise. 


(A25) 



One can show that, by suitable choices of and 02, all 
(/)^° can be made to be identical and equal to p37r/2. To 
simplify the terms that involve P4, we consider another 
gauge transformation, 

h{ri,r2,a) = 7r(ri+r2), 
G5 = { Mri,r2,e) = 7r(ri+r2), (A26) 
4'5{ri,r2,as) = 7r(ri + r2 + 1) asi{a,e}, 



which does not modify Gti , and , but transforms 
'/>it(r) as 



4>Riri,r2,as) _pi7rrir2 + (p4 + l)7rr2 



+ 



^r2(r2 



(A27) 



Here, 5a^.f = 1 when as = f and zero otherwise. In 
contrast to the case of Kagome lattice where the term 
P47rr2 can be gauged away by the transformation G5, it 
becomes p^TrSa^j in the star lattice. Moreover, we can 
neglect the constant tt because it correspond to an IGG 
operation. Finally, we arrive at 



4>R{ri,r2,as) = Pi7rrir2 + ^^r2(r2 - 1) (A28) 

(A29) 



PlTT 

2 

— +P4TTda,J- 
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